Using Argument Mining to Assess the Argumentation Quality of Essays
نویسندگان
چکیده
Argument mining aims to determine the argumentative structure of texts. Although it is said to be crucial for future applications such as writing support systems, the benefit of its output has rarely been evaluated. This paper puts the analysis of the output into the focus. In particular, we investigate to what extent the mined structure can be leveraged to assess the argumentation quality of persuasive essays. We find insightful statistical patterns in the structure of essays. From these, we derive novel features that we evaluate in four argumentation-related essay scoring tasks. Our results reveal the benefit of argument mining for assessing argumentation quality. Among others, we improve the state of the art in scoring an essay’s organization and its argument strength.
منابع مشابه
The Effect of Dynamic Assessment of Toulmin Model through Teacher- and Collective-Scaffolding on Argument Structure and Argumentative Writing Achievement of Iranian EFL Learners
Considering the paramount importance of writing logical arguments for college students, this study investigated the effect of dynamic assessment (DA) of Toulmin model through teacher- and collective-scaffolding on argument structure and overall quality of argumentative essays of Iranian EFL university learners. In so doing, 45 male and female Iranian EFL learners taking part in the study were r...
متن کاملImproving Argument Mining in Student Essays by Learning and Exploiting Argument Indicators versus Essay Topics
Argument mining systems for student essays need to be able to reliably identify argument components independently of particular essay topics. Thus in addition to features that model argumentation through topic-independent linguistic indicators such as discourse markers, features that can abstract over lexical signals of particular essay topics might also be helpful to improve performance. Prior...
متن کاملOntology-Based Argument Mining and Automatic Essay Scoring
Essays are frequently used as a medium for teaching and evaluating argumentation skills. Recently, there has been interest in diagrammatic outlining as a replacement to the written outline that often precedes essay writing. This paper presents a preliminary approach for automatically identifying diagram ontology elements in essays, and demonstrates its positive correlation with expert scores of...
متن کاملTowards Feasible Guidelines for the Annotation of Argument Schemes
The annotation of argument schemes represents an important step for argumentation mining. General guidelines for the annotation of argument schemes, applicable to any topic, are still missing due to the lack of a suitable taxonomy in Argumentation Theory and the need for highly trained expert annotators. We present a set of guidelines for the annotation of argument schemes, taking as a framewor...
متن کاملAn Attempt to Combine Features in Classifying Argument Components in Persuasive Essays
So far, several approaches have been done in detecting and classifying argumentation in persuasive essays. In this paper, we proposed some new features on top of the state-of-the-art researches in argumentation mining. We grouped 68 features into 8 categories; they are structural, lexical, indicators, contextual, syntactic, prompt similarity, word embedding, and discourse features. Instead of h...
متن کامل